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ABSTRACr 

This  paper  considers  the  synthesis  of  linear  reduced  order  filters 
and  the  synthesis  of  linear  full  order  filters  with  minimum  com])lexity. 
The  objective  of  a reduced  order  filter  is  to  estimate  a linear  trans- 
formation of  the  state  vector  with  a filter  of  lower  dimension.  This 
t>T»e  of  filter  occurs  frequently  in  applications.  Several  cases  are 
studied.  In  a number  of  cases  it  is  shown  that  singular  arcs  exist. 

In  instances  where  certain  filter  parameters  are  not  subject  to  optiini 
zation,  it  is  shown  that  the  remaining  parameters  can  be  optimized  with 
a relatively  simple  procedure.  Closed  form  solutions  for  a number  of 
cases  have  been  obtained. 


I.  INTRODUCTION 

Tile  problem  of  optimal  linear  filtering  has  been  examined  from  manv 
viewiwints,  including  treatment  within  a control  theoretic  framework 
|1|.  In  this  paper  we  wish  to  address  the  problem  of  estimating  a 
linear  tnms  format  ion  of  a state  vector  using  a filter  which  may  he  of 
reduced  order  relative  to  the  dimension  of  the  state  vector.  Control 
metliodo logics  are  used  to  optimize  the  parameters  of  the  filter. 

Tlic  motivation  for  this  paper  is  based  on  tlie  fact  that  often  one 
is  only  interested  in  estimating  a portion  of  a state  vector.  In  a higii 
accuracy  pointing  ;md  tracking  system  for  aircraft  to  satellite  tracking 
[2],  for  extimple, one  might  be  primarily  interested  in  estimating  certaiti 
physical  variables  such  as  angular  rate  of  the  line  of  sight  and  the 
pointing  misaligimient  errors.  The  state  vector  might  be  vejy  large, 
however,  containing  many  states  associated  with  detailed  models  of  the 
error  producing  mechanisms  in  inertial  instruments.  If  one  were  to 
design  a full  order  filter,  the  complexity  would  be  intolerable  from 
, the  viewpoint  of  a flight  computer  implementation.  Such  difficulties 

V have  long  been  recognized  and,  consequently,  there  has  been  considcr.al)lc 

♦ ’ * 
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research  in  this  area  [3-9].  Within  a detenninistic  framework, 

Luenberger  has  shown  that  one  may  acJiieve  considerable  reduction  of 
couifilexity  in  the  state  reconstruction  process  when  only  a linear  com- 
bination of  the  state  variables  is  required  [10].  It  would  seem  that 
a similar  reduction  in  comnlexity  should  occur  when  the  problem  is 
stochastic.  Indeed,  it  will  become  clear  that  this  paper  has  some 
relationship  to  obser\'er  theory. 

Although  the  primary'  thrust  of  this  paper  is  towards  the  reduction 
of  filter  conplexity  through  order  reduction,  it  will  be  shown  that  it 
is  even  possible  to  reduce  filter  complexity  in  the  full  order  case, 
lliis  happens  because  for  certain  classes  of  problems  the  Kalman  filter 
is  not  the  only  solution  [i ] . Other  estimators  can  result  in  the  same 
value  for  the  performance  measure. 

riic  papc'T  is  divided  into  five  sections.  Section  II  cast.«  the  est  i 
mation  process  into  a deterministic  control  problem  which  then  can  be 
solved  via  use  of  the  matrix  minimum  principle.  Section  III  contains 
the  development  of  the  problem  solution.  The  conditions  for  unbiasc-cines;; 
are  developed  aivd  the  necessary  conditions  for  optimality  are  given. 
Several  cases  v\hcre  exact  anclytical  solutions  to  the  two  point  boundaiy 
value  problem  may  be  found  are  presented. 

T!ie  first  special  case  is  that  of  terminal  time  estimation.  Tlie 
iim)ortancc  of  this  case  may  be  foinid  in  orbit  determination  ajid  in 
geodetic  model  determination  in  which  one  is  interested  in  the  optimal 
estimate  at  only  one  time  instant.  The  solution  for  this  case  yields 
a singularity  whidi  may  be  taken  advantage  of  by  choosing  the  simplest 
filter  configuration.  By  choosing  part  of  the  structure  a priori,  one 
needs  to  solve  a siirple  linear  two  point  boundary  value  problem  v.hich  i'^ 
easily  accomplished.  The  second  and  third  special  cases  are  that  of  an 
interval  estimation  problem.  The  optimal  reduced  order  solution  is  given 
in  closed  form  in  these  cases  for  various  assumptions  on  tlie  transfonna 
tion  (whether  time  inv'ariant  or  time  varying)  of  the  lull  order  states 
to  the  reduced  state  space. 


Section  IV  considers  the  solution  to  the  two  point  boundary  value 
problem  when  part  of  the  stnicture  is  chosen  a priori.  A Riccati  solu- 
tion is  given.  Tiiis  solution  may  be  done  off  line  and  the  gains  either 
stored  or  approximated.  Section  V considers  examples  of  the  results. 

The  ability  to  obtain  simple  structures  for  filtering  allows  one 
to  implement  the  least  corn^lex  filter.  This  will  yield  a vast  savings 
in  on  line  computation  or  hardware  implementation. 


II.  PROBLEM  STATEMENT 

The  system  of  interest  is  a Markov  process  satisfying  a linear 
stochastic  differential  equation 

x(t)  = A(t)x(t)  +w(t).  (1) 

The  observation  model  is  also  linear 

y(t)  = C(t)x(t)  + v(t).  (2) 

The  state  vector  x is  of  dimension  n and  the  observation  vector  y is  of 
dimension  m.  It  is  assumed  that  the  initial  value  of  the  state  vector, 
x(to),  is  uncorrelated  with  the  plant  noise,  w(t),  and  the  measurement 
noise,  v(t).  The  noise  processes  are  zero  mean  white  processes,  uncor- 
related with  each  other,  hav:^ng  covariance  matrices 

n!w(t)w^(T)[  = Q(t)6(t-T) 

' ' (31 

E jvft)  v"^(t)  I = R(t)6(t-T). 

The  initial  state  of  the  system  has  mean  and  vari;mce 

i;{x(to)}  = Uo 


Var{x(to)}  = Pq 


(4 


Ihe  problem  is  to  estimate  a linear  transformation  of  the  state 
vector 

zft)  = N (t)x(t)  (5) 

where  z is  of  dimension  and  jiresumably  the  H'^n  matrix,  N(tl,  is 

selected  to  indicate  the  part  of  the  system  which  i'^  of  primary  concern. 
;As  an  examjile,  if  N(t)  = C(t),  then  we  are  interested  in  the  noise  free 
output  as  indicated  by  (2).  The  filter  ^o  be  optimized  is  of  the  fonn 


z(t)  = F(t)z(tl  > K(t)}  (t)  + gft) 


(b) 


4 


wliere  z is  of  dimension  1.  'iTie  error,  e(t),  is  defined  as 

e(t)  = z(t)  - z(t).  (7) 

The  deterministic  vector,  g(t),  and  the  filter  initial  condition  zfto), 
are  to  be  determined  so  that  the  filter  is  unbiased,  i.e., 

E{e(t)}  = 0 Vt>to.  (8J 

Note  that  wc  do  not  require  conditional  unbiasedness  which  is  a much 
stronger  7equircment . llie  matrices  F(t)  and  K(t)  arc  then  to  be  deter- 
mined so  that  the  performance  measure 

J = E I e''  (t)U(t)e(t)dt  + e'^'(t.)Se(t.)  [ 19) 

<*to  * M 

is  a minimum.  It  is  assumed  that  the  weighting  matrix  S is  positive 

definite.  The  weighting  matrix  U(t)  is  critical  to  the  problem  fonnula- 

tion,  CIS  we  obtain  different  results  depending  upon  whether  tliis  matrix 

is  j)ositive  definite  or  zero.  It  can  make  sense  to  liave  Uft)  be  zeio, 

when  the  only  time  of  real  importance  is  the  final  time  such  as  in 

orbit  detenninatioci.  Indeed  when  U(t)  is  zero  ?md  N is  a constemt 

t rans fonnat ion , it  will  be  seen  that  performance  does  not  depend  on 

F(t). 


III.  PROBLEM  SOLUTION 

We  shall  first  examine  the  requirements  for  unbiasedness.  By  direct 
substitution  from  fl),  (2),  (.S) , and  (6J , the  error  equation  is  obtained 
e = [N+NA-FN'-KClx  + Pe  + NV  - Kv  - g.  (10) 

If  g(t)  IS  selected  as 

g = [N+NA-FN-KClu  (11) 

where  u(t]  is  the  mean  value  of  the  system  state, 

li(t)  = A(t)u(t)  ; u(to)  = Uo 

then  it  is  clear  that  taking  expectation  of  (101  gives  a homogeneous 
result 

Ele(t)}  = F(t)lHe{t)l.  (12j 

Tluis  if  l ieltn)}  = 0,  equation  (81  is  satisfied.  Ihis  is  true  if 

z(to)“N(tol)Jo  (1.^1 


\ 


since  then 

hieftoH  = E{N{to)xfto)  - N(to)Uo}  = 0 (1^-^) 

and  the  desired  result  follows.  Hence  (11)  is  the  cxi)ression  needed  for 
g(t)  rmd  (13)  specifies  the  filter  initial  condition.  Equation  (10)  can 
he  rewritten  as 

e = [.N+NA-HN-KC]x  + Fe  + Nw  - Kv  (15) 

where  x = x-u  satisfies  tlie  linear  e()uation 

X = Ax  + w.  (lb) 

Certainly  x is  a zero  nx?an  process  having  initial  variance  Pq.  it  is 
convenient  to  work  with  the  second  moment  matrix  associated  with  (15) 
and  (16)  in  formulating  the  optimal  control  problem  which  will  give  the 
requirements  for  F and  K. 

Tiie  performance  measure  (9)  can  be  written  as 

J = trjj^^^^  U(t)P^^(t)dt  ^ SP,Jt,.i  I (171 


where 

P^^(t)  = Eje(t)o'^'(t)[. 

, iSi 

From  (15), 

P satisfies 
ee 

P = [.N+N.A-FN-KC1P-  + FI’  + P ^F^ 

ee  ^ xe  ee  ee 

( 19) 

+ P^-[N+NA-F'N-KC]^  + NQn"^  + KRK^ 

whe  re 

Pe-(t)  = F.je(t)  xft)"^  [ = C')' 


Using  (15)  ;md  (1ft),  it  is  easy  to  show  that 

P_  = AP-  + P— IN+NA-F\'-KCl‘  + P-  f‘  + ()n‘  (2!  I 

xe  \e  xx'^  ' xe  ' 

where 

P— (t)  = Ejx(t)x''^(t)  j (22) 

satisfies  the  eciuation 

P—  = AP  - + P-- + Q.  23) 

XX  XX  XX  ^ 

fhe  tern  P satisfies  the  transpose  of  (21).  Initial  conditions  f(^r 

C.  A 

(19),  (21),  and  (23)  are 


ft 


P^e(to)  = Pp^rto)  - N(to)Po 


(24) 


" rUtojPoN^to). 


'ITie  matrix  P)5f(^)  regarded  as  a known  quantity  since  it  is  the 

solution  to  (25),  i.e.. 


P~-(t)  = 0(t,to)Po4>^  (t,toJ  ^ 4>(t,T)Q(T)t^  (t,T)dt 


(25) 


wliere 

and 


4)(t,t)  = I 


(|)(t,T)  = A(t)iJ)(t,T) , (2b) 

The  optimization  problem  may  then  be  stated  in  a deterministic  way,  so 
that  the  matrix  minimum  principle  is  applicable.  The  problem  is 
to  minimize  (17)  by  properly  selecting  F and  K,  subject  to  the  con 
straints  imposed  by  (19)  and  (21).  To  preserve  symmetry  we  include  tne 
transpose  of  (21)  in  the  Hamiltonian  also, 
lire  Hamiltonian  for  this  nrohlem  is 


I ♦ T • 1'  • T I 

11  = tr  UP  + P A + P-  A-  + P -A 

I ec  cc  ee  xe  xo  ex  ex  j 

ihe  equations  for  the  Lagrange  multiplier  matrices  arc 

A = - — - = - ju  + + A F I 

ee  9P_„  ( ee  ec  ( 


ce 


xc 


3H 


9P- 


xe 


= - a"‘A-  + At  F + [N'+NA-Pi-KCl^A 

I XC  xc 


ee 


with  teniiinal  cenditions 
and 


A (tj  = S 
ee  f 


0. 


(27) 

(28) 
(29) 

(3Uj 

(51) 


The  matrix  A^—  is  just  the  transpose  of  Setting  the  gradient  nf  11 

with  resnect  to  K cciual  to  zero  gives  a necessaiv  condition  for  the 
optimum  gain 


= fp  - + a'*  a - P— Ic^r'^ 
L ex  ee  ex  xx  J 


152) 


where  R and  have  been  assumed  to  be  nonsingular.  The  matrix  F pre- 
sents a difficulty  since  it  appears  linearly  in  the  Hamiltonian.  It  is 
convenient  to  proceed  as  in  [14]  by  examining  that  part  of  the  Hamil- 
tonian vvtiich  depends  explicitly  on  F,  defined  <'is 

H*  = trjp0  e’^F^j  (33) 

where 


Clearly  what  we  have  called  0 is  just  the  transpose  of  tlie  gradient 
matrix,  9H/3F.  From  the  initial  conditions  (24),  it  may  be  seen  that 
0(to)  is  zero.  It  is  necessary  to  examine  the  time  derivatives  of  0 
to  determine  the  possible  existence  of  a singular  arc.  Since  different 
requirements  will  be  obtained,  it  is  convenient  to  ex;imine  0 under 
different  conditions.  It  is  required  that  0(t)  equal  zero  for  all 
te[t|j,t^]  if  a singular  arc  is  to  exist. 

3.1  Case  1 

In  this  first  case,  it  is  assumed  that  U(t)  is  zero.  Then  it 
follows  that 


0 = F0  + 0F  + K 


RK^A  - CP--A-  - CP-  A 
ee  XX  xe  xe  ee 


(35) 


Ihe  bracketed  tenii  in  (35)  is  zero  whenever  K(t)  is  selected  optimally, 
according  to  (32).  'fhercfore  (35)  becomes 


0 = FO  + 0F 


(36) 


;md  since  0(t(,l  is  zero,  (36)  assures  us  that  G(t)  remains  zero  for  all 
tf  [tg,t|-],  regardless  of  our  choice  of  F.  The  inTplications  of  this 
result  are  significant.  In  tlie  full  order  case  (N=I),  as  was  pointed 
out  in  [1  J , the  Kalman  filter  is  just  one  solution,  i.e.,  one  of  the 
optimal  linear  filters.  ITiis  means  that  for  final  time  estimation 
problems,  one  should  examine  other  realizations  of  the  optimum  linear 
filter.  It  will  be  seen  that  such  realizations  can  be  easier  to  imple- 
ment than  the  Kalman  filter.  We  have  demonstrated  here  that  for  reduced 
order  filters  also  the  solution  is  not  unique.  One  c.in  pick  F for  some 
other  reason  than  minimizing  J,  sudi  as  to  reduce  sensitivity,  to  satisfv 
a constraint,  or  to  minimize  some  performajice  measure  involving  F. 
Consider  adding  a nonnegative  term 


R 


.1, 


itljdt 


to  the  performance  measure  J Kiven  in  (]7).  Since  0=0,  it  is  seen  tiiat 
a necessar)'  condition  for  F to  be  optimal  is  that 

= 0 Vtc[t,,t^].  (38) 

For  cxairple,  it  may  be  advantageous  to  use  a measure  of  F as 

p[F(t)l  = tr{F(t)'^F(t)}  f39) 

wiiich  weights  the  magnitude  of  the  elements  of  F.  Tnis  particular  choice 
of  p yields  an  F identically  equal  to  zero.  This  clearly  is  tlie  simiUest 
solution  for  F. 

.^1  alternative  metliod  of  choosing  the  gain  K may  proceed  as  follows. 
This  alteniative  method  shows  from  another  approach  that,  indeed,  the 
results  contained  herein  are  roasonrible.  Let  0^^  be  the  transition 
matrix  for  the  optimal  Kalmmi  filter.  Obviously,  this  is  the  transition 
matrix  associated  with  (A-KoC)  where  Ko  is  the  optimal  Kalman  gain.  If 
one  considered  the  solution  of  the  Kalman  filter  at  the  final  time, 
assuming  zero  initial  conditions,  i.e.. 


= J ^ N'(t^)'I>j^pftj-,T)Ko  (TlyltjdT  , 


where  Xq  is  the  optimal  Kalmaji  estimate,  and  the  solution  for  the 
filter  developed  hcreiri,  i.e., 


•'to 


where  I'p  is  the  trimsition  matrix  :issociated  with  F,  then  it  may  be 
noticed  tliat  it  is  sufficient  for  optimality  that  z{tp)  to  be  equal  to 
Zo(tp),  and  this  holds  if 

N(tp)l'py,.ftp,T)Ko(T)  = $p(tp,T)KfT3  , VT£[t(|,tp].  (42) 

Since  F is  arbitral^'  for  the  singtjlar  solution  or  is  zero  for  the  solu- 
tion of  the  problem  with  (39)  in  the  Hamiltoniaji,  F may  be  chosen  as 
..ero.  If  this  is  the  case  then  the  solution  for  the  reduced  order 
filter  gain  is 


1 


K(t)  = N(tp)$^p(tj.,t)Ko(t) 

where  the  transition  matrix  »t)  may  be  calculated  from 


dt 


" ■ ‘i'ppCtp, t ) (A-KqH ) 


t43) 


(441 


whidi  is  integrated  backwards  from  = I.  The  solution  for 

K(tl  may  be  accomplished  offline  and  either  stored  or  approximated. 

Probably  the  most  advantageous  property  of  the  singularity  with 
respect  to  F is  computational.  If  !■  is  picked  a priori,  then  one  only 
needs  to  solve  a linear  two-point  boundary- value  problem  (TPBV'P) , which 
is  easy  to  do  using  linear  systems  theory.  Alternatively  one  can  use 
a procedure  which  leads  to  a Riccati  equation  type  of  solution.  Those 
methods  are  examined  in  a later  section. 

.3.2  Case  2 

In  this  case  .N  is  constant  but  U is  fissumed  to  be  positive  definite. 

This  leads  to  ai  additional  term  in  (36),  i.e., 

G = F0  + 0F  - (P  - NP-  )U.  (43) 

' ee  xe / ' 

Hence  it  is  required  that 

^ee^^^  " Vte[t„,tp|  (46) 

since  U is  positive  definite.  Clearly  this  cannot  be  satisfied  for 

arbitrary  F.  TIius  the  existence  of  the  singular  arc  depends  on  the 

choice  of  F in  this  case.  Defining  fi, 

n P - ,VP-  (471 

ec  .xe  ' 


it  is  seen  that 


Q = HI  + (IF^  + (P  --NT’rr )fN,A-FN'KC]  - K[Rk’’'-CP- 


(48) 


ex  XX ' ‘ ' xe 

It  is  required  that  T2(t)  equal  zero  for  all  t in  the  interx'-al  of  nitcrcst. 
From  (24)  it  is  apparent  that  is  zero.  In  order  to  develop  the 

equat ion 

n = FQ  + .Qf'  (49) 

so  that  H(t)  is  zero,  it  is  requiied  that 

NA  - FN  - kC  = 0,  (.30) 

This  leads  to  the  result  from  (29)  that 

Ap-(t)  = 0 (51) 


in 


so  tliat  the  gain  is  evaluated  as 

K(t)  = P -(tjC^(t)R'\t1.  (521 

Cr  X 

Clearly  (52)  implies  that  the  last  term  in  (48)  is  zero,  ;ind  we  have  the 
desired  result.  Thus  if  F can  be  dtosen  so  that  (50)  is  satisfied,  a 
singular  arc  exists,  provided  K is  selected  according  to  (52).  In  the 
full  order  case,  when  N = I,  the  proper  choice  of  F is 

F = A - KC.  (53) 

The  TPB\T  is  then  solved  by  the  Kalman  filter,  a result  whidi  is  ea^^ilv 
verified.  In  tJie  reduced  order  case,  (50)  is  simply  the  observer  con- 
straint equation,  [10].  If  the  randomness  were  removed  from  the  problem. 
(50)  is  required  so  that  z(t)  = Nx(t)  for  t^to  if  there  is  no  driving 
vector,  g.  liquation  (46)  has  an  interesting  interpretation.  It  is  easv 
to  sec  that  it  is  just  the  orthogonality  requirement  in  a reduced  space. 


Kjzft)e’^'(t)  j = 0.  (54! 

It  miLst  be  made  clear  that  it  is  not  always  possible  to  satisf)'  (50)  ;vi<i 
(52)  simultaneously,  and  consequently  it  is  not  always  possible  to  h.ive 
a singular  arc.  In  such  cases  the  problem  should  probably  be  refor.nulate 
with  bounds  on  F,  or  a suboptimal  solution  accepted. 

A necessary  and  sufficient  condition  that  there  be  a solution  i-  (or 
(50)  is  that 

(NA-KC)N'’n  = N,\  - KC  Vte[tj,,t^l  C55) 

4- 

where  N'  is  a pseudo  inverse  of  tlic  matrix  N.  In  this  case  the  solution 
for  F is 

F = 1.\'A-KC]n'  + r[I-NN’  ] (.36) 

where  V is  an  arbitrar)’  1x9.  matrix  Il2l.  In  particular  if  NN'*  is  non- 
singular, then 

F = [NA-KCIN*  [NN^r^  (57) 

is  a solution.  Uhen  the  F of  (5~)  cait  he  fouiid,  the  K which  is  the 
solution  to  (52 1 c;ui  be  evaluated  by  solving  the  equation 


P - 
ex 


+ NQ 
ex  ^ 


(58) 


trom  initial  condition  (24),  and  substituting  tlie  result  in  (52).  Note 

that  there  are  onlv  J.^'n  elements  in  P - which  may  be  far  less  than  if  we 

ex 


were  to  solve  tlve  problem  by  estimating  x first,  and  then  ase  the  result, 
z = Nx.  Doing  it  that  way  would  require  solving  a Riccati  equation  witli 
n(n+l)/2  distinct  elenvents. 

3. 3 Case  3 

In  this  case,  N is  not  constajit.  By  some  fortunate  cancellation, 
(45)  is  still  applicable  but  (48)  is  not.  liquation  (48)  is  replaced  by 

h = I'Q  + + (p  - - NP— )[N+NA-R1-KC]  - KIRk'-CP-  ].  (59) 

Ft  is  clear  that  fl(t)  will  be  zero  if 

N + NA  - FN  - KC  = 0.  (60) 

Ihen  (51)  and  (52)  and  (54)  are  still  true.  To  be  able  to  solve  (60) 
for  F-,  it  is  necessary  and  sufficient  that 

(N+NA-KC)N'N  = [N+NA-KCiVtcttg,t^l.  (61) 


Ihe  solution  for  F-  is 

r = [n+na-kc]n''  + rfi-NN']. 

Again  ifNN'  is  nonsingular 

F-  = 

The  gain  can  then  be  found  by  solving  the  equation 


[N+NA-KC]N^'[NN^]'^ 


Vx  ' 'Vx-''’  * [n 


N^NA'l’ 

GX 


' -1  1 Tf  T 
R -^C  N NN 


-1 


P - + NQ 
ex 


(62) 

(63) 

(64) 


from  the  proper  initial  condition  and  substituting  the  result  in  (52). 


FV.  SOLUTION  FOR  SPFXIFIC  F 


Fn  Case  1,  it  was  found  that  the  singular  arc  did  not  specify  I-. 

In  Cases  2 ;uid  3,  it  is  ver>"  possible  that  no  F can  bo  found  to  maintain 
the  singular  arc.  Therefore  it  is  appropriate  to  investigate  the  solu- 
tion to  the  TPBVP  when  F is  specified  a priori.  Ft  is  observed  that 
A^^(t)  can  bo  precortaited  in  this  case,  aitd  may  be  regarded  as  a known 
quantity. 


A 

ee 


(t) 


'Kt,tf)S^'^(t,tj.) 


ij;(t,  t)U(  I Hi^(t,T)di 


(65) 


where  _ 

^ = - F> 

i(j(t,t)  = I. 
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Substituting  the  expression  for  the  gain  (32),  in  (22)  and  (29)  results 
in  a linear  TPBVT  since  P— (t)  and  A (t)  are  known.  Equation  (22/ 

XX  00 

becomes 

I^^-In+NA-Fn]^  + F-  + QN^  - P-— c'^R'^^cFf- + F— A-  A'H. 
xe  xe  XXL  J xe  ^ xx  L xe  xx  xc  eej 


Equation  (29)  is  rewritten  as 


A‘A-  - A-  I 
xe  xe 


• - in+N/A-fnI^a  + c^r'V;p-  + c^r'^cp— a-  a‘^ 

L J ee  xe  xx  xe  ee 


Equations  (66)  and  (67)  are  linear  in  the  unknowns  P-  and  A-  , so  there 

xe  xe 

is  no  difficulty  other  than  possibly  the  high  dimensionality  of  the 
problem  to  contend  witii.  If  A^^  is  a scalar  matrix,  iiowever,  things  work 
out  particularly  well.  Suppos<?  F,  U,  and  S are  scalar  matrices,  i.e., 

F = fl 

U = ul  (68) 

S = si. 

Then  obviously  A is  a scalar  matrix  also.  We  can  thus  reposition  A 


and  F in  (66)  and  (67)  obtaining 

P-  = A+F-P— C^R'-’-cIp-  - A' 

xe  L XX  J xe  e/ 


- - A'^P— -C^R'^CP— A-  + P— 

xe  ee  XX  xx  xe  xx 


n+na-fn]^  + Qir 

L J (hQ 


(UiU 

= ■ lA^+F-A'j[cV^CP— 1a-  + cV^CP-  - fN+NA-ld^l^A  . (70) 

xe  L ee  xxj  xe  xe  L J ee  ^ 

Note  that  upon  repositioning,  the  dimension  of  I in  (68)  will  change  in 

general.  It  is  convenient  to  make  the  following  definitions 

Gii  ^ A + F^  - P— C^R'^C 

XX 

r,2i  ^ cV^c 

Gaj  -A  - [a'+F-A^^C^R'^CP-I 
D,  ^ P— [N+NA-FN]'^  + Q.n' 

Dj  ^ - [N+Ni\-FN]'^A^^. 


Then  we  have 


* 

I 

, !> 


or 


• 

p- 

xe 

o 

Gi  2 

• 

A- 

xe. 

G2 1 i 

G22 

r _ 

“1 

r 

"xe 


D, 


(72) 


• 

P — 

P- 

xe 

= G 

xe 

A- 

A- 

_ xe. 

xe_ 

+ D. 


(73) 


The  boundary  condition  for  P-^  is  at  to  and  for  A— ^ is  at  t^. 
the  transition  matrix  associated  with  G,  i.e., 


If  <3>  is 


4>  = 

and  <I>(t,t)  = I then 

P~  (t)  = 

xe 

Also 


• 

'I’ll 

• 

$12 

n ' 

Gi  2 

• 

$2 1 

• 

4>2  2 

G2 1 

G22 

^il(T»To 

<tl2( 

4>ii 

<I>]  2 

'j’2  1 

^2  2 

(74) 


xe 


* /*  [♦u(t. 

*'to 


t)Di(t)  + 'l>i2(t,t)D2(T) 


dr. 


(7S) 


0 = A-g(t^)  = to)P-g(to)  + 4>22(tf,to)A-g(to) 

+ f ^ r<f2l(tf,T)Di(T)  + 4>2  2(t£,T)D2(T)jdT.  i?()) 

One  can  solve  (76)  for  ^-^(to),  substitute  the  result  in  (75)  and  solve 
(75)  for  P-  (t)  in  terms  of  P-  (to).  Similarly,  one  can  solve  for  A-  (t) 

XC 

using 


A-g(t)  = <t2l(t,to)P^g(to)  + <t>22(t,to)A-^(to) 


f k2l(t,T)Di(-t)  + 4’22(t,T)D2(T)jdT. 

*'to 


(77) 


The  results  can  then  be  substituted  in  (32)  to  get  the  optimal  gain. 
Under  certain  conditions  the  above  procedure  is  a good  approach.  Some- 
times it  is  convenient  to  ase  an  approach  which  leads  to  a Riccati 
equation. 

4 . i,  A Riccati  Solution 

Here  we  assume  that  A^^  can  be  written  as 
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w 


Then 

A- 

xe 

A-  = MP-  + 6. 
xe  xe 

= [M  + MGn  + MG12MJP-  + MDi  + 6 + MG12B 

(78) 

i 

and 

• 

1 

[ 

A— g = [G21  + G2  2MJP— g + G226  D2 . 

(79) 

1 

t 

If  (78)  and  (79) 

are  to  hold  for  arbitrary  P-^,  then 

[ 

1 

M + MG  11  + MGj2M  — G2 1 G22M 

(80) 

[ 

and 

6 + MDi  + MG126  = G22B  D2 • 

(81) 

Since  A—  (tr)  = 
xe  f 

0,  the  above  equations  are  solved  backwards  in 

time  from 

■ 

conditions 

M(tj)  = 0 

(82) 

and 

6(tf)  = 0. 

(83) 

Solving  the  Riccati  equation  (80)  and  the  equation  for  6 must  be  done 

off  line,  as  in  a linear  regulator  problem,  since  the  result  is  to  be 

obtained  by  backward  integration.  The  forward  equation  for  P-  is 

xo 

P~e  = (Gn  + C,i2M)P^g  + G126  + Di  (84) 

which  is  solved  from  the  appropriate  initial  condition  either  on  lijie 
or  off  line  depending  on  computer  requirements.  The  gain  to  be  used  in 
the  filter  is  then 

K = + A'VmP- +e)^P— IcV^.  (85) 

L xe  ee'  xe  ' xxj 

The  results  presented  in  this  section  are  suboptimal  in  general , and 
optimal  in  the  situation  referred  to  as  Case  1. 


V.  EXAMPLES 

The  first  example  considers  estimating  the  output  of  a generalized 
Wiener  process,  i.e.,  the  noise  is  Gaussian,  A equals  0,  N=C,  and  the 
problem  is  in  the  category  indicated  as  Case  3.  It  is  assumed  that  a 
solution  to  (60)  exists  and  that  CC^  is  nonsingular.  The  optimal 
estimate  of  z(t)  = C(t)x(t)  is  obtained  using  the  filter 
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Ut)  = C(t)c'^’(t)[c(t)c'^ft)]'^z(t)  + K(t)[y(t)-z(t)l 
with  initial  condition 

z(to)  = C(tjMo 

and  gain 

K(t)  = Pg-(t)c'^(t)R'^t) 

where 

P - = CC"^  fee'll '^P  - + CQ  - P -€ W - 
ex  L J ex  ^ ex  ex 

with  initial  condition 


Pex(to)  - C(to)Po- 

Alternatively,  since  CP— g = Pgg,  K may  be  evaluated  as 

,-l, 


K(t)  = PggCt)  R nt) 


where 


P^^  = [CCT(CC'^)'1-K]p^g  + P^^[cc'^(cc’^)'^-k]'^’  + CQC' 


+ KRK^. 


The  above  is  appealing  since  P^^  has  fewer  elements  to  calculate  tJiiin 


xe 


The  next  example  is  of  the  category  referred  to  as  Case  1 vdiere  a 
full  order  filter  is  used.  It  is  a scalar  case.  The  problem  is  to  get 
a best  estimate  of  x at  t = T vdiere 

X = 0 


y(t)  = x(t)  + v(t). 

Initially  at  t = 0 x has  mean  zero  and  variance  1,  and  v(t)  is  zero  mean 

white  noise  with  unity  covariance  parameter.  If  F is  selected  as  zero 

the  filter  is  particularly  simple  with  a constant  gain 

At  1 

z(t)  = x(t)  = pTpy(t). 


Ihe  initial  condition  is  x(0)  = 0, 

P(t)  = 1 


The  meaji  square  error  is 
(l-*-2T)t  ^ t^ 
d^T]' 


evaluated  at  t = T,  tlie  above  gives 

p(T)  - 

which  is  exactly  what  one  would  get  using  a Kalman  filter.  The  filter 
is  simpler  than  a Kalman  filter,  but  the  mean  square  error  is  larger 
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than  the  Kalmaji  filter  except  at  t = T wliere  the  meaji  square  error  equals 
that  of  the  Kalman  filter.  Tliis  is  illustrated  in  figure  1 with  T = 1. 
Note  t'nat  the  filter  we  have  developed  in  this  example  is  of  the  sniiK* 
structure  as  the  MAP  receiver  for  estimating  a constant  as  presented  in 
Van  Trees  [13]. 

The  third  example  illustrates  both  Cases  1 and  2.  In  this  exami)lc 
the  system  is  given  by  a second  order  dynamic  model  representing  a 
vehicle  with  random  thrust,  i.e., 


Xi 

~ — 
0 1 

Xl 

H 

s 

+ 

X2 

1 

O 

o 

1 

\ 

CSJ 

X 

1 

w 

where  Xj  represents  the  position  of  the  vehicle  and  x?  the  velocity  and 
w is  a zero  mean  white  noise  thrust  with  covariance  q.  The  vehicle 
position  is  observed  via 

y = Xi  + r 

where  r is  zero  mea]i  white  measurement  noise  with  covariance  r.  A 
reduced  order  filter  is  to  be  designed  in  order  to  estimate  the  position 
of  tlie  vehicle.  Tlie  realizations  for  tlie  Kalman  filter  and  the  filter 
developed  here  are  shown  in  figures  2 and  3.  We  have  selected  F = n.  The 
estimation  performance  index  used  is  etiuation  (17).  The  values  for  q and 
r are  10.  and  1.  respect iv^ely.  The  final  time  was  chosen  as  one  second, 
ihe  first  case  is  that  of  final  time  estimation  (U  = 0 and  S = 1)  ;ind  tiie 
second  case  corresponds  to  U = 100.  and  S = 1.  figure  4 shows  the  meaii 
square  value  of  the  first  case.  Ihe  Kalman  results  are  not  shown  .is  the 
two  results  are  nearly  coincident.  A measure  of  deviation  from  the 
Kalmtui  results  of 

■'*  ■ ('ee  - ’’ki-H' 

to 

where  P,,,.  is  the  Kalman  filter  mean  square  error  yields  J = 0.0()4.s 

Ki 

Figure  5 shows  the  mean  square  value  of  the  second  case.  Again,  the 
results  are  too  close  ti  plot  separately.  'Ihe  measure  of  deviation 
yields  J*  = 0.0052 . 
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VI . REMARKS  AND  CONCLUSIONS 


i 

I 

I 


We  have  presented  new  results  in  optimal  ajid  suboptimal  filtering. 
Ihese  results  are  very  attractive  for  implementation  purposes  particularly 
for  problems  where  the  Kalman  filter  is  of  too  great  a dimension  to  be 
practical,  llie  results  herein  are  in  closed  form  and,  thiis , it  is  not 
necessary  to  solve  a difficult  two  point  boundary'  value  problem.  Some 
relatively  simple  realizations  may  be  obtained  via  off  line  computation. 

One  of  the  limitations  of  the  results  is  that  there  may  be  problems 
whereby  a solution  for  F as  in  (50)  or  (60)  may  not  exist.  Also,  one 
cannot  conclude  that  the  filter  is  conditionally  unbiased  when  F is 
specified  arbitrarily. 

However,  the  results  can  be  used  in  a number  of  problems  to 
decrease  the  on-line  conputational  burden  with  the  filter  structures 
described  in  this  paper,  and  this  is  exceedingly  important  in  many 
applications.  This  paper  yields  a method  for  synthesis  of  reduced 
order  filters  as  well  as  a class  of  full  order  filters  of  simpler 
structure. 


ii 
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